Flexible, modular electronic element patterning method and apparatus for compiling, processing, transmitting, and reporting data and information

ABSTRACT

A method and apparatus for compiling(acquiring and storing), processing (analyzing, integrating, and organizing), transmitting, and reporting data and information, which is comprised of a flexible, modular system that overcomes major limitations of conventional and multidimensional databases. The method and apparatus utilizes computer programming code modules and modules of logically arranged digital signal function and formula formations to :(a) acquire data/information units using modules of query instruction items and response instruction items, which can be presented via a branching-logic process, (b))store the responses to the items in independent record files and internal database files, (c)integrate them with digital signals stored in other sources via an integration file, (d)process the digital signals in the digital signal processing files, (e) produce portable report files, and (f)generate reports utilizing report format tiles.

BACKGROUND

1. Field of Invention

This invention relates to the management of data and information using aflexible, modular electronic element patterning method and apparatus. Inthe present invention the term "data" refers to alphanumeric values,text, and other physical and mental symbols representing measures,classifications, and other descriptions of objects, forces, behaviors,concepts, beliefs, emotions, and other phenomena (occurrences, events,circumstances). Independent units of data do not, in and of themselves,convey intelligible/meaningful (understandable, comprehensible,significant, denotative) information; but when they are combined withcertain other data, they can form intelligible/meaningful patterns ofinformation. In the present invention, therefore, the term "information"refers to data that have been formed into intelligible/meaningfulpatterns. These informational patterns can be expressed (stated,manifested, indicated) as:

(a) statistical representations of data relationships (e.g.,descriptives of central tendency and dispersion, ANOVAS, correlations,regressions, nonparametic tests, modeling statistics, and continuous,discrete, and non-central distributions);

(b) graphical representations of data relationships (e.g., categoricalcharts, SQC charts, histograms, and scatterplots, caseplots, time-seriesplots, normal probability plots, and cross-correlation function plots);

(c) visual or auditory signals and signs indicating the existence orabsence of specific data relationship conditions, such as using colors,alphanumeric symbols, pictures, or sounds to indicate whether certaindata have met specified criterion conditions represented by other data,(e.g., a buzzer sounding on a smoke detector when data from thedetector's sensor, which represents the current smoke level, is greaterthan other data in the detector's memory, which represents a criterionindicative of a safe level of smoke);

(d) visual or auditory signals and signs which identify an entity (athing, occurrence, etc.) represented by a datum (a single data unit),such as using a series of words (i.e., strings of alphanumeric datasymbols) to describe what another datum means (e.g., placing the datum"44" adjacent to the alphanumeric symbol/words "=the person's years ofage", thereby conveying the information "the person is 44 years old");and

(e) other visual, auditory, and other suitable representations of othermeaningful data relationships.

While information is comprised of intelligible/meaningful data patterns,information can be organized (e.g., categorized, indexed) intointelligible/meaningful patterns to produce useful knowledge. In thepresent invention, data and information are represented by electronicelements (digital signals). The method and apparatus of the presentinvention compiles, integrates, and transmits electronic elements ofdata and information from a multitude of sources, arranges them intoelectronic element patterns, and utilizes these patterns to generatesintelligible/meaningful reports, indicative of the data and information,for enhanced knowledge.

In the fields of science, healthcare, criminal justice, education, humanresources, financial forecasting, governmental management, politicalanalysis, and other fields and industries where the management complexdata and information is essential, there is need for a more flexible andefficient means by which to compile (i.e., acquire and store), process(i.e., integrate, organize, and analyze), and report useful data andinformation to the end user.

2. Description of Prior Art

Currently, relational and non-relational databases and databasemanagement systems for mainframes, servers, and personal computer(hereinafter referred to as "conventional databases") are widely usedfor the compilation, organization, and analysis of complex electronicdata, and for the reporting of information. Conventional databasesinclude, but are not limited to: DB2 (by IBM Corp.), CA-IDMS (byComputer Associates Corp.), Informix Online, SQL and 4GL (by InformixSoftware Inc.), Oracle 7 RDBMS (by Oracle Corp.), Sybase SQL Server andIQ (by Sybase Inc.), Alpha Five 2 (by Alpha Corp.), DataEase (byDataEase International Inc.), DBExpert (by Designer Software Inc.),FileMaker Pro (by Claris Corp.), Approach (by Lotus Development Corp.),Microsoft SQL Server, Access and FoxPro (by Microsoft Corp.), Paradox(by Borland International Inc.), R:BASE (by Microrim Inc.), and Salsafor the Desktop (by Wall Data). While such databases can obtain, store,organize, and report large quantities of data, they have inherentlimitations which restrict their usefulness and efficiency. The presentinvention overcomes major limitations of conventional databases byproviding a more flexible and efficient method and apparatus by which tomanage the electronic element patterns comprising data and information.

One limitation of conventional databases involves the data inputprocess. It can be difficult to program branching logic algorithms (analgorithm is a set of step-by-step procedural computer instructions,which may be comprised of programming code written in any suitablemachine language object code, assembly, and high-level language sourcecode, software application macros, and software application functionsand formulas that perform decision-making, action-taking, andvalue-returning operations) to facilitate entry of raw (unprocessed)data into a conventional database. Branching logic instructs a computerto request the entry of specific data depending upon certain prior datathat was entered. This branching process navigates data entry requestsso that only data relevant to specific conditions are requested. Forexample, if a response to a request for data concerning a person'smarital status indicates the person was never married, then branchinglogic would instruct the computer to skip a subsequent request for dataabout the date of marriage. In conventional databases, utilizingbranching logic can require complex, multiple step programmingprocedures at each data entry point for which navigational branching isto be activated.

Another set of limitations of conventional databases are a result oftheir strict structural parameters. In both personal computer (PC)computer network servers and mainframe computer databases, all data mustbe organized into highly structured, inflexible arrays (matrix-like datapatterns). In the terminology of PC and server databases (mainframecomputer databases may use somewhat different terminology), all databasearrays are comprised of fields (columns) and records (rows), and eachcomplete array must be configured as a complete table (a collection offields and records about a specific topic). These structuralrequirements substantially restrict the flexibility and efficiency ofelectronic element storage and patterning resulting in the followingdatabase limitations:

In a "normalized" database, different fields (which may have differentamounts of records in each) are stored in their own tables. The tablesmay then be "joined" (electronically linked or interconnected, using anindex consisting of a common field or "primary key" to match recordsacross tables), which enables the relationship between the fields indifferent tables to be analyzed. This use of tables saves storage spaceby allowing the fields and their records to appear only once in thedatabase, but analysis time is increased since relational joins are anexhaustive process. That is, analyzing records in joined tables requiresthat each record be matched against every other record in every table.

In a "denormalized" database, on the other hand, all tables are combinedinto a single table, which avoids time consuming analysis of joins, butcreates other disadvantages. One limitation of denormalized databases isthat they can produce extremely large tables since all fields are in asingle table. Performing analyses with large denormalized databases canbe very time consuming because many more disk I/Os (i.e., transferringdata into and out of a storage device when memory is exhausted) andprocessing time are required since the entire database must be scanned,as opposed to scanning only the relevant tables of a normalizeddatabase.

Regardless of whether normalized or denormalized databases are used,each record in a table must have the exact same fields, even if certainrecords have empty fields (they lack information and/or data). Thesparseness (emptiness) increases the database size with wasted space,which negatively impacts performance without adding additional data.

The type of data stored in each database field must be precisely defined(e.g., as being currency, date/time, text, numbers, and visual orauditory objects). Once defined, no data other than those conformingwith the defined type are accepted by the database. This can causeproblems if the end user wants to enter multiple types of data in aspecific field.

There is considerable "overhead" in a database's data "file" (a file theprimary unit of digital signal storage in a computer, which enables theCPU to distinguish between one collection of data and information fromanother). That is, mixed in with the raw data are computer-read symbolswhich are required to maintain the database's structural and functionalintegrity, but which increases the size, complexity and instability ofthe database without adding useful information and/or data.

Records and tables are neither independent nor portable. That is,records cannot be separated from nor stored independently of the tablesin which they reside and tables cannot be separated from nor storedindependently of the database file in which they reside. Thus, anindividual record or table cannot be transported (moved) to anothercomputer disk (or other storage device) without transporting the entiredatabase file. This limitation means that if the data and information anend user must access is contained in a single record in a specificdatabase table, the end user must have access to the entire databasefile, which requires having a copy of the entire file on the end user'sown computer or using a LAN or WAN to access the file. A more efficientalternative is to simply store the individual record on the end user'sPC, independently of all the other records, and to utilize a reportgeneration program to produce a report utilizing the contents of thatrecord.

To exemplify the greater efficiency afforded by using independent,portable records, consider that a single record with five fields storedindependently as an ASCII delimited file is approximately 4,300 timessmaller than the same record stored as the only record in a MicrosoftAccess database file. If a Microsoft Excel spreadsheet file is used togenerate a simple report based on the aforedescribed record and theMicrosoft Access database is set up with a similar report function, thenthe former is over 8 times smaller than the latter. Furthermore, sincethe size of a conventional database increases with the number of records(e.g., by increasing the aforedescribed Access database file from 1record to 5,000 records, the database file increases in size by over 29times), it is often not sensible to store large database files on anindividual PC; instead, network access is required to retrieve a singlerecord. Thus, using an independent, portable file to store a singlerecord and using a separate report generator to produce a report fromthat record is substantially more efficient because they save muchstorage space and, by being easily stored in a PC, they can eliminatethe necessity of continual network access.

Another limitation of conventional databases is the scope ofcomputational analyses they can perform on data. Specifically, they cancompute only the sum, average, count (frequency), minimum, maximum,variance, and standard deviation, and perform simple arithmeticcomputations of the data sets they contain. They are not designed, forexample, to perform statistical computations such as correlationalanalyses and analysis of variance or to make forecasting ("what-if")analyses.

A further limitation of conventional databases is their weakness indealing with certain aspects of historical (i.e., longitudinal) data.Since they typically keep only one version of the database at any onetime, it can be difficult for a user needs to examine previous databasestates or check data trends over time.

Furthermore, the flexibility of conventional databases' reportgeneration functions are limited by their failure to utilize easilydesigned and readily modifiable algorithms for precise control of thecontent and appearance a report.

Now that some of the limitations of conventional databases have beendiscussed, attention is turned to "On-Line Analytical Processors"(OLAPs), which attempt to overcome some of the shortcomings ofconventional databases by using "multidimensional database" structures.OLAP multidimensional database tools include: Acuity/ESAcuity (byManagement Systems), Acumen (by Enterprise SolutionKenan Systems),Advance for Windows (by Lighten, Inc), Clementine (by Integral SolutionsLtd), Commander OLAP (by Comshare), CorVu (by CorVu/InformationServices), DecisionSuite Server (by Information Advantage), CrossTarget(by Dimensional Insight Inc), Delta Solutions (by MIS AG), DSS Agent (byMicroStrategy), DynamiCube OCX (by Data Dynamics, Ltd), EKS/Empower (byMetapraxis), Essbase (by Arbor Software Corporation), Gentia (byPlanning Sciences), Holos (by Holistic Systems), Informix HypercriptTools (by Informix), InfoAssistant (by Asymetrix), InfoBeacon (byPlatinum Technology, Inc), IQ/Vision and DataVisionIQ (by SoftwareCorp), macControl (by Breitschwerdt & Partners), Marketing Warehouse (byMSSI), Media (by Speedware Corporation), Oracle OLAP (by Oracle),PowerPlay (by Cognos, Inc.), Qbit (by Zenia Software, Inc), SAMACMIT/400 (by Samac Pty Ltd), TM/1 (by Sinper Corp), Visualizer (by ASTRACLtd), and WIRED for OLAP (by AppSource Corporation).

Briefly, multidimensional database structures can be visualized as cubesof data within cubes of data (i.e., "hypercubes"). Each cube of data iscomprised of "cells", which contains aggregated (consolidated, combined)data that relate elements along each dimension. Each side of the cube isa "dimension", which represents a different data category (typicallytime, measures, products, geographical regions, sales channels, etc.).In other words, multidimensional database structures typically arrangeaggregated data elements into logically ordered layers of interconnectedgrids comprised of rows and columns.

Their multidimensional database structures enable OLAPs to enhance someof the capabilities of conventional databases. For example, OLAPs can:

(a) save storage space by reducing the size of indexes that are used tolocate specific data and by not saving empty fields in records therebyreducing sparseness;

(b) improve performance because smaller indexes use up less memory;

(c) deal better with historical data by using time as a dimension for"time series" analysis of data; and

(d) enhance data viewing via utilization of multidimensional scenarios,such as "pivoting" or "rotating" data (i.e., combining data in differentways, such as swapping columns and rows) and viewing hierarchicalrelationships between components (i.e., "members") of a dimension in atype of outline form.

OLAPs do not, however, address many of the limitations of conventionaldatabases. For example, OLAPs:

(a) use only data in existing databases since they do not compile theirown raw data;

(b) are subject to the structural confinements of the hypercube and thustheir data elements lack independence and portability (including theinability to utilize independent record files); and

(c) the flexibility of OLAPs' report generation functions are limited bytheir failure to utilize easily designed and readily modifiablealgorithms for precise control of the report's content and appearance.

It should also be noted that "artificial intelligence" (AI) programsprovide another method for analyzing data. Briefly, AI programs use datafrom conventional databases to build and maximize the accuracy ofpredictive models (i.e., mathematical models which predict trends basedon existing data, etc.). They build and optimize the models via use of a"neural network", which is a mathematical structure that simulates humanlearning. Neural networks "learn" the complex higher order relationshipsbetween inputs (e.g., process conditions, materials attributes, etc.)and outputs (e.g., other process conditions, product attributes andquality) by repeatedly analyzing and readjusting defined models forincreased accuracy. AI programs, while providing another mechanism foranalyzing database contents, are not designed to overcome theaforedescribed limitations of conventional databases and OLAPs.

Objects and Advantages

Accordingly, the objects and advantages of the present invention involveovercoming the aforedescribed limitations of conventional andmultidimensional databases through use of a flexible, modular electronicelement patterning method and apparatus ("system"). Each of the modulesutilized by the present invention is flexible, efficient and independent(i.e., able to be readily modified without disrupting the structure orcontent of the other modules). Specifically, the modules comprising thepresent invention are:

(a) data/information compilation modules utilizing computer programmingcode and branching logic to facilitate the acquisition and storage ofdata and information;

(b) record file modules comprised of independent record files forstoring individual records as flexible, efficient electronic elementpatterns and internal database files for storing database records intables;

(c) data/information processing and transmission modules utilizingcomputer programming code and logically arranged computer function andformula formations for analyzing, integrating, and organizing data andinformation into flexible, efficient electronic element patterns andtransmitting them (i.e., sending them to different locationselectronically);

(d) supplemental data/information modules containing referenceinformation, and data from external databases; and

(e) report generation modules utilizing computer programming code,logically arranged computer function and formula formations, and reportformat templates for producing and transmitting intelligible/meaningfulreports reflecting the aforedescribed electronic element patterns.

Some of the ways that the present invention's radically new modularsystem provides more flexible and efficient management of data andinformation than capable with conventional and multidimensionaldatabases are:

(a) large quantities of data can be compiled efficiently utilizing easyto use branching logic routines;

(b) there is no need to define the type of data and information in afield, so multiple types of data can be entered into a single field;

(c) each record containing the raw data does not need the same fields asany other record, thereby eliminating sparseness by storing in eachrecord only those fields containing data;

(d) records can be stored independently of one another (i.e., they neednot be associated with a table nor stored within a database file),thereby eliminating much of the overhead required for structuralintegrity in conventional and multidimensional databases;

(e) the data or information in any one field of any one record can beprocessed, independent of or in conjunction with the contents of anyother field(s) of any other record(s), using any suitable algorithm,thereby providing unprecedented analytic capabilities;

(f) the algorithms which generate a report are stored independently ofthe raw and processed data and information and independently of thealgorithms which process the data and information, thereby enablingcontinual modifications of the report generation algorithms withoutdisrupting other system components;

(g) the algorithms which integrate information and/or data from aplurality of sources are stored independently of the information and/ordata, thereby enabling continual modification of the algorithms withoutdisrupting the raw and processed data and information; and

(h) there are no inherent structural parameters, such as the relationaldatabase grid or OLAP multidimensional database structure, therebyaffording exceptional flexibility of database design.

Still further objects and advantages will become apparent from aconsideration of the ensuing descriptions and drawings.

DRAWING FIGURES

In the Drawings:

FIG. 1 illustrates a block diagram of the apparatus of the presentinvention;

FIG. 2 illustrates an operational flow diagram of the data compilationsteps of the data/information compilation method utilized in the presentinvention;

FIG. 3 illustrates a block diagram of the data/information compilation,record file, data/information processing, supplemental data/information,and report generation modules utilized in the present invention;

FIG. 4 illustrates a block diagram of the query and response instructionmodules utilized in the present invention;

FIG. 5 illustrates a block diagram of the query and response instructionheader code components of the method of the present invention;

FIG. 6 illustrates an operational flow diagram of the data/informationprocessing and report generation steps of method of the presentinvention, and

FIG. 7 illustrates an operational flow diagram of the possibledirections of data and information flow of the present invention.

    ______________________________________                                        Reference Numerals In Drawings                                                ______________________________________                                        1    Computer Apparatus                                                                            60     Response Instruction Header                       2    CPU                    (RIH)                                             3    ROM device      64     Response Instruction Code                         4    RAM device             (RIC)                                             5    Input device    68     Record file Module (RFM)                          6    Presentation device                                                                           72     Response Instruction                              7    Output device          Identifier (RIID)                                 8    Storage device  76     Response Instruction Format                       9    Backup system          Code (RIFC)                                       10   User interactive interface                                                                    78     Input Prompt Code (IPC)                                device          80     Data Unit (DU)                                    20   Data/Info Compilation                                                                         84     Direct Response (DR)                                   Module (DCM)    88     Passive Response (PR)                             24   Data/Info Compilation                                                                         92     Response Validation Code                               Code Module (DCCM)     (RVC)                                             28   Query Module (QM)                                                                             100    Internal Database File (IDF)                      30   Query Unit (QU) 104    Table Record (TR)                                 32   Query Item (QI) 112    Branching Logic Code (BLC)                        36   Query Item Header (QIH)                                                                       116    Branching Criteria (BC)                           40   Independent Record file                                                                       120    Branch-To Location (BTL)                               (IRF)           124    Data/Info Processing Module                       44   Query Item Identifier  (DPM)                                                  (QIID)          128    Data/Info Processing Code                         48   Query Item Format Code Module (DPCM)                                          (QIFC)          132    Data/Info Processing                              52   Response Instruction   Function/Formula                                       Module (RIM)           Module (DPFM)                                     54   Response Instruction Unit                                                                     136    Data/Info Retrieval and                                (RIU)                  Processing File" (DRPF)                           56   Response Instruction Item                                                                     140    Processed Data/Info File                               (RII)                  (PDF)                                             146  Aggregate Data/Info Units                                                                     144    Extended Table Record (ETR)                            (ADU)           164    Portable Report Data/Info                         150  Supplemental Data/Info File (PRDF)                                            Module (SDM)    168    Report Generation Code                            152  Reference Data/Info File                                                                             Module (RGCM)                                          (RDF)           172    Report Generation Function/                       154  Data/Info Integration File                                                                           Formula Module (RGFM)                                  (DIF)           176    Report Format File (RFF)                          156  External Database Files                                                       (EDF)                                                                    160  Report Generation Module                                                      (RGM)                                                                    ______________________________________                                    

SUMMARY

The present invention provides a flexible, efficient electronic elementpatterning method and apparatus for compiling (acquiring and storing),processing (analyzing, integrating, and organizing), transmitting(sending digital signals to different locations), and reporting(outputting) data and information. The method and apparatus of thepresent invention overcomes major shortfalls of conventional andmultidimensional databases.

The apparatus of the present invention is comprised of a digitalcomputer system comprising a Central Processing Unit (CPU), Read OnlyMemory (ROM) device, Random Access Memory (RAM) device, input device,storage device, presentation device, backup system, and user interfaceand delivery device. These components enable the computer system tocompile, process, transmit, and report information and/or data from oneor a plurality of end users in one or a plurality of locations.

The method of the present invention comprises a process that compiles,processes, and reports data and information utilizing five distinct, yetrelated modules. Data/information compilation modules are comprised ofelectronic files containing computer algorithms, alphanumeric text, andvisual and auditory "objects" (i.e., basic visual and auditory elements)in electronic form. The modules are utilized to acquire informationand/or data efficiently using branching logic and to store them asdigital signals in data/information file modules. The data/informationfile modules are comprised of efficient independent record filescontaining the information and/or data of a single entity and ofinternal database files containing the information and/or data of aplurality of entities. The independent record files provide an efficientmeans of storing and transmitting raw data and information. Supplementalmodules comprised of reference files and external databases are utilizedto augment the compiled information and/or data with additional data andinformation. Processing modules comprised of easily modifiable computerprogramming code, functions, and formulas are utilized to analyze,integrate, and organize the information and/or data. Report generationmodules are comprised of files of data and information in efficient,easily transmitted digital signal formations and of report format filesof easily modifiable computer programming code, functions, formulas,alphanumeric text, and visual and auditory electronic objects. Thereport format files are utilized in conjunction with the files of dataand information formations to produce output reports. While each of themodules comprising the present invention is utilized with the othermodules, each is structurally independent, thereby preventingmodifications made in one module to disrupt the content and structure ofthe other modules.

Description--FIG. 1

FIG. 1 illustrates a block diagram of the apparatus of the presentinvention which is denoted generally by the reference numeral 1. Theapparatus of the present invention is comprised of a Central ProcessingUnit (CPU) 2 which is utilized for obtaining, processing, and reportingat least one element (unit) of data and information. The CPU 2 mayoperate in a microprocessor, a microcomputer, a mainframe computer, asupercomputer system, or a molecular computer depending upon theapplication and the digital computer system employed.

The apparatus 1 is also comprised of a Read Only Memory (ROM) device 3for the storage of the operational program data or codes which controlthe operation of the apparatus and which is further comprised of anyadditional software programs or codes which direct the apparatus 1 toperform the method utilized in the present invention. In this manner,the method of the present invention may be embodied solely as a computerand/or software program or codes. A Random Access Memory (RAM) device 4is also utilized for storing the data and information, which will bedescribed in more detail below. Note that any other suitable memorymethod may also be used such as PROM, EPROM, and "bubble memory". Aninput device 5 is utilized in the apparatus 1, which may be a keyboard,mouse, joy stick, optical scanner, electronic pen, modem, magnetic stripreader, LAN device, WAN device, touch screen, camera, touch pad,biologic measurement device, microphone, infrared device, ultrasounddevice or any other suitable means for entering data, information anduser control commands into a digital computer system.

The apparatus 1 is also comprised of a user presentation device 6 forpresenting information related to the operation of the presentinvention. In this respect, the operation of the apparatus 1 may befacilitated by the display of on-screen menus, the sounding of audiospeakers, and any other suitable means which may allow a user, via theuser input device 5, to select apparatus operations or in other waysexert control over the present invention. The presentation device 6 mayalso present requests for input information and/or data to the user intext, graphics, audio, video, multimedia, and any other suitableformats.

The apparatus 1 is further comprised of an output device 7 which may beor which may include a printer and plotter for generating output dataand information such as hard copy reports, an amplifier and speaker forgenerating audio representations of the data and information, a modem orother suitable telecommunication means for electronically transmittingoutput data and information or report data and information to remotelocations, and other suitable output means for presenting data andinformation. The presentation device 6 may also function as an outputdevice 7 by displaying a visual, audio, and any other suitablepresentation of output data and information.

The apparatus 1 is further comprise of storage device 8 which iscomprised of a hard disk, floppy disk, compact disk, magneto-opticaldrive, tape drive, magnetic strip, or other suitable means is used forstorage of data and information in digital form.

The apparatus 1 may also comprise a backup system 9 which is comprisedof a CPU 2', a ROM device 3', a RAM device 4', and storage device 8',which are identical to the CPU 1, the RAM device 4, the ROM device 3,and storage device 8, respectively, described above. The backup system 9serves as a redundancy system in the event of a failure or malfunctionof any of their primary system counterparts (CPU 2, ROM device 3 and RAMdevice 4, and storage device 8, respectively). In this manner, duplicatefiles may be stored.

The apparatus 1 may also comprise a user interactive interface anddelivery system 10. The user interactive interface and delivery system10 may be a separate computer (not shown) which may contain ROM and RAMmemory devices, data input and user command entry devices, which mayinclude a keyboard, a mouse, and/or a modem or any other suitabledevice, and a data output device which may be a printer or any othersuitable device for obtaining, receiving or storing data output reports.The user interactive interface and delivery system 10 is designed to beutilized by remote users and is further designed to be located at remotelocations such as at the locations of the above described users. Theuser interactive interface and delivery device 10, may be interfacedwith the apparatus 1 of the present invention either viatelecommunication means and/or other suitable communication networkswhich may include direct communication link-ups and/or radiocommunication link-ups via transmitting and/or satellite communicationsystems or means.

The user interactive interface and delivery device 10 provides a meansby which to allow a remote user, as defined above, to access theapparatus 1. This may allow for a direct transmission of data andinformation to be entered via any suitable data entry means located atthe user's location. It should be noted that adequate precautions are tobe taken so as to prevent a nonauthorized user from accessing theapparatus 1 and the data, information, or algorithms stored therein. Anyinformational reports, if desired, may be electronically transmitted tothe user via the user interactive interface and delivery device 10wherein the report or reports may be output via the output means (notshown), which may be a printer or other suitable output device, orwherein said report data may be stored in a user memory device.

Utilization of the user interactive interface and delivery system 10 inFIG. 1 may be accompanied by a security scheme or means whereby the usermay be required to input a user password or access code in order toaccess the system and/or decrypt data and information that has beenpreviously encrypted. Any other suitable security system may also beutilized to safeguard the apparatus 1 of the present invention as wellas a user's files and/or other interests. The security scheme or meansmay also be provided to ensure security and confidentiality of data andinformation. Further, the device 10 allows for an expedited data andinformation entry process as the data and information may be entereddirectly and/or instantaneously into the apparatus 1.

Further, the apparatus 1 of the present invention may be adapted toservice multiple users over multiple channels in a network environmentsuch as in local area networks (LANS) as well as wide area networks(WANS) wherein the present invention may be utilized over communicationsand/or long distance communication lines or systems such as telephonenetworks (phone lines) and/or radio communication and/or satellitecommunication networks.

Further, the user interactive interface and delivery system 10 may beemployed to allow a user access to unsecured databases, or portionsthereof, which may be stored in the apparatus 1 or which may be used inassociation with the present invention. The user interactive interfaceand delivery device 10 therefore may also provide for a means by whichthe present invention may be utilized as an on-line database. In thismanner it can be seen that the present invention, which may be utilizedin conjunction with network systems described above, can be utilized forproviding vast amounts and varieties of data and information.

The CPU 2 operates under the control of the system operational softwarewhich is stored in the ROM device 3 memory device. The operationalsoftware of the apparatus 1, as will be described in more detail below,provides for complete control over the operation of the method of thepresent invention. The operational software may be provided in anyprogramming language (i.e., BASIC, FORTRAN, COBOL, PASCAL, VISUAL BASIC,VISUAL C++, and any other suitable programming language) or it may beimplemented in assembly or assembler language for the particularmicroprocessor or CPU utilized, depending upon the digital computer orprocessor utilized as well as depending upon any of the specificapplication constraints.

The present invention is premised upon a user interactive scheme whereindata is input via the input device 5, into the apparatus 1 and processedso as to provide informational reports. The operation of the presentinvention will be described below with reference to FIGS. 2 through 7.

Operation--FIGS. 2 to 7

In the preferred embodiment of the present invention, an electronic"data/info compilation module" (DCM) 20 method is utilized to compiledata and information of interest to the end user. In an alternateembodiment of the present invention, a nonelectronic DCM 20 method isutilized. FIG. 2 illustrates an operational flow diagram of the steps ofthe electronic DCM 20 method of the preferred embodiment. The alternateembodiment of the nonelectronic DCM 20 method will be described at alater point below. Note that the electronic and nonelectronic DCM 20methods comprising the steps of FIG. 2 are optional since, as will alsobe described at a later point below, information and/or data compiled bymeans other than the DCM 20 method can be utilized in lieu of (as wellas in addition to) data and information compiled via the DCM 20 method.

The electronic DCM 20 method is initiated by the user at step 200. Atstep 201, the identification code of an electronic "query module" (QM)28, which is comprised of alphanumeric strings (series of letters,numerals, and the combination of letters and numerals) that indicate thespecific QM 28 to be used, is input via the input device 5. Tofacilitate description of the electronic DCM 20 method, the componentsof the electronic QM 28 are described below.

FIG. 3 illustrates a block diagram of the five basic module structuresof the preferred embodiment of the present invention. The first modulestructures, at block 301, will now be described; the other four moduleswill be described in detail at a later point below. Note that eachmodule utilized in the present invention is "independent", which meansthat modifications made to any one module does not disrupt the structureor content of any other module. Beginning at block 301, threesub-modules comprising the electronic DCM 20 are:

a "data/info compilation code module" (DCCM) 24, at block 301A;

the QM 28, at block 301B; and

a "response-instruction module" (RIM) 52, at block 301C.

The DCCM 24 is comprised of one or a plurality of files containingprogramming code that operates the electronic DCM 20 program viainstructions to the CPU 2. The programming code may be written in anysuitable programming language. The electronic QM 28 may be comprised ofone or a plurality of QMs 28. The components of electronic QM 28 aredescribed in the block diagram of FIG. 4, beginning at block 401 anddescribed below. Each electronic QM 28 is stored in the storage device 8as digital signals in at least one file.

The electronic QM 28 is comprised of at least one "query unit" (QU) 30,indicated at block 401A. A series of QUs 30, of any quantity, maycomprise the QM 28. Each QU 30 has two associated components, each ofwhich are utilized by the CPU 2 via programming code of the DCCM 24. Onecomponent is a "query item" (QI) 32, indicated at block 401B. The QI 32,which is a question or other means of obtaining at least one element ofinformation and/or data of interest to the end user, can be comprised ofalphanumeric text, graphics, pictures, sound, video, and any otherformat suitable for presenting questions and other means of obtainingdata and information on the presentation device 6. The other componentof the QU 30 is a "query item header" (QIH) 36, indicated at block 401C.The QIH 36 is, itself, comprised of six components which are illustratedin the block diagram of FIG. 5.

Beginning at block 501, the components of the QIH 36 are identified:

(a) At block 501A is a "query item identifier" (QIID) 44 which iscomprised of a unique alphanumeric string that identifies a particularQI 32.

(b) At block 501B is a "query item format code" (QIFC) 48 whichindicates the mode of QI 32 presentation, that is, it indicates how theQI 32 is presented in the form of text, sound, graphics, pictures,video, and any other suitable form of QI 32 presentation (described ingreater detail below).

(c) At block 501C is a "response instruction code" (RIC) 64 which is analphanumeric string that indicates the type of response instructionassociated with the QI 32 (described in greater detail below).

(d) At block 501D is a "branching logic code" (BLC) 112 which is analphanumeric string that indicates the Boolean branching logicassociated with the QI 32, which instructs the CPU 2 to branch to aparticular QI 32 under specified conditions (described in greater detailbelow).

(e) At block 501E is a branching criterion (BC) 116 which is used inconjunction with the aforedescribed BLC 112 to define certain conditionsof the branching operation (described in greater detail below).

(f) At block 501F is a "branch-to location" (BTL) 120 which is used inconjunction with the aforedescribed BLC 112 to define the destination ofthe branching operation (described in greater detail below).

Returning to FIG. 3, the RIM 52 is located at block 301C. There may beone or a plurality of RIMs 52 in the present invention. Components ofthe electronic RIM 52 are illustrated in FIG. 4, at block 402. At block402A is a "response instruction unit" (RIU) 54. The RIU 54 has twocomponents, each of which are used by the CPU 2 via programming code ofthe DCCM 24. One component of the RIU 54 is a "response instructionitem" (RII) 56, indicated at block 402B. The RII 56 presentsinstructions relating to how the QI 32 is to be answered. The RII 56 mayinclude alphanumeric rating scales (e.g., 1 through 9, true-false,yes-no, fill in the blank, multiple choice), visual objects (i.e., adigital pictures or videos), sound objects (i.e., digital soundrecordings), or another suitable modes of responding to the QI 32 viathe input device 5. Note that the RIU 54 may request multiple types ofdata, such as the use of a RII 56 scale instructing the end user to"Enter the number of months or `DK` if you don't know." The othercomponent of the RIU 54 is a "response-instruction header" (RIH) 60, atblock 402C, which will be described in detail at a later point below.

Returning to FIG. 2, at step 202 the name of an "independent recordfile" (IRF) 40 is input via the input device 5. A "record" is acollection of related information and/or data that are treated as asingle unit, thus, the IRF 40 is an electronic file containing acollection of related data that are treated as a unit. In the IRF 40, aunit of information and/or data may refer to a single "entity" (i.e., aperson, company, organization, object, situation, event, and any otherentity or occurrence). Returning to FIG. 3, one component of a "recordfile module" (RFM) 68 is the IRF 40, which are indicated at blocks 302,at block 302A, respectively. The other components of the RFM 68 aredescribed in detail at a later point below.

The data and information in the IRF 40 are obtained via use of one or aplurality of electronic and/or nonelectronic QMs 28. If the same QM 28is used on multiple occasions with the same entity, the data andinformation obtained from each subsequent QM 28 can either be appendedto the previously acquired data and information in a single IRF 40 orthey can be saved in new IRFs 40 in storage device 8. These data andinformation are stored in files in the storage device 8 as digitalsignals, in ASCII delimited or any other suitable format, by the CPU 2via programming code of the DCCM 24.

Note that there are additional processes by which the IRF 40 can beconstructed. One process involves transforming a record from "internaldatabases" (described later) and/or "external databases" (also describedlater) into the IRF 40. The specifics of this transformation process isdetailed at a later point below.

A name given to the IRF 40 may be any string of alphanumeric symbolsaccepted by a computer's operating system (an operating system iscomprised of the programming code that enable it to manage all of itsinternal tasks, functioning as the intermediary between software andhardware). If multiple IRFs 40 are created as a result of theaforedescribed repeated use of the same QM 28, each IRF 40 must have adifferent name, such as by changing the file name extension to indicatethe number of times the same QM 28 was used. Note that the electronicdata compilation method may be designed to enable input of the IRF 40name to precede input of the QM 28 identification code.

Returning once again to FIG. 2, at step 203, which is an optional step,the name of the IRF 40 is encrypted by the CPU 2 via programming code ofthe DCCM 24, using any suitable computer algorithm that changes the namein such a manner that a decrypting algorithm is required to restore theoriginal name. The purpose of this step is assure the confidentialityand security of the data within the IRF 40 by minimizing the possibilitythat the entity to which the IRF 40 refers can be identified byunauthorized persons. Note that any other suitable encryption-decryptionmethods may be utilized, at any suitable point during the method of thepresent invention, in addition to or in lieu of the aforedescribed filename encryption routine. The encrypted IRF 40 name may be presented bythe presentation device 6 at any point while the electronic datacompilation method is active or it may be withheld until verificationfrom an authorized individual, such as via entry of a password.

At step 204 in FIG. 2 the CPU 2 searches the storage device 8, viaprogramming code of the DCCM 24, and locates the electronic QM 28 whoseidentification code was input at Step 201. At step 205 the CPU 2 "reads"(i.e., puts into the RAM 4 and/or other suitable memory devices) the QIH36 in "focus", via programming code of the DCCM 24. The term "focus" isused in the present invention to refer to the QI 32, QIH 36, RII 56, andRIH 60 currently targeted to be read or "written" (i.e., presented viathe presentation device 6) by the CPU 2. That is, it refers to where theCPU 2 is focusing its operations. In the QM 28 with more than one QU 30,the DCCM 24 instructs the CPU 2 as to which specific item or header tofocus upon.

At step 206, which is an optional step, the CPU 2 writes to thepresentation device 6 the aforedescribed QIID 44 from the QIH 36 infocus, via programming code of the DCCM 24. At step 207, the CPU 2 readsthe QI 32 that is associated with the QIH 36 in focus via programmingcode of the DCCM 24. At step 208, the CPU 2, via programming code of theDCCM 24, writes the QI 32 to presentation device 6 as indicated by thequery item format code (QIFC) 48. The QIFC 48 may indicate that the CPU2 write the QI 32 as text, sound, graphics, pictures, video, and anyother suitable form presentation. The QIFC 48 may also instruct the CPU2 to present the QI 32 for a fixed period of time, to present the QI 32until it is responded to, to present the QI 32 sequentially in aplurality of formats or to present the QI 32 in any other suitablemanner.

At step 209 the CPU 2 reads the response instruction code (RIC) 64 ofthe QIH 36 in focus via programming code of the DCCM 24. The RIC 64 isan alphanumeric string that indicates a specific response instructionunit (RIU) 54 associated with a particular QI 32. The RIU 54 wasaforedescribed in FIG. 4 at block 402A as being the primary component ofthe response instruction module (RIM) 52. The components of the RIU 54,furthermore, are the aforedescribed response instruction item (RII) 56at block 402B and the response instruction header (RIH) 60 at block402C.

Returning to FIG. 5, the components of a RIH 60 are identified,beginning at block 502:

(a) At block 502A is a "response instruction identifier" (RIID) 72,which is comprised of a unique alphanumeric string that identifies aparticular RII 56.

(b) At block 502B is a "response instruction format code" (RIFC) 76which indicates the mode of RII 56 presentation, that is, it indicateshow the RII 56 is presented in the form of text, sound, graphics,pictures, video, and any other suitable form of RII 56 presentation(described in greater detail below).

(c) At block 502C is an "input prompt code" (IPC) 78 which indicates theformat of an input prompt, presented via the presentation device 6,which prompts the user for inputting a response to the QI 32. The IPC78, together with programming code of the DCCM 24, instructs the CPU 2to present a specific input prompt. The input prompt may be a visualcue, such as a line on the presentation device 6 upon which a responseis typed on a keyboard via the input device 5; an auditory cue, such asa beeping sound presented by presentation device 6; and any othersuitable cue for inputting a response.

(d) At block 502D is a "response validation code" (RVC) 92 which is analphanumeric string that indicates whether the type of response to theQI 32 is acceptable (described in greater detail below).

Returning once again to FIG. 2, at step 210 the CPU 2, via programmingcode of the DCCM 24, searches each RIH 60 of each RIU 54 within the RIM52 until it finds the RIID 72 that matches the RIC 64 of the QIH 36 infocus. At step 21, the RII 56 and the IPC 78 that are associated withthe RIID 72 matching the RIC 64 are written to the presentation device 6by the CPU 2 via programming code of the DCCM 24. The mode of RII 56presentation is determined by the RIFC 76 as aforedescribed. Note thatthe RII 56 may be presented while its associated QI 32 is presented,after a period of time following the presentation of the QI 32, or atany other suitable time. Also note that the duration of RII 56presentation can be equal to, less than, or greater than the duration ofthe QI 32 presentation. Further note that a plurality of QIs 32 may bepresented before a single RII 56 is presented.

In an alternate embodiment it is possible to bypass the aforedescribedsteps 209 and 210 by combining the QI 32 with its RII 56, that is,presenting the QI 32 at step 208 that includes within it the responseinstructions. This involves merging the QI 32 with the RII 56 to form anextended QI 32 that contains both a query and response instruction. Anexample of this extended QI 32 is the presentation, at step 208, of thefollowing: "What is your gender? Enter `M` for Male or `F` for Female".In this alternate embodiment the RIH 60 is comprised of theaforedescribed IPC 78 and RVC 92, but is not comprised of theaforedescribed RIID 72 and RIFC 76.

At step 212, a "direct response" (DR) 84 and "passive response" (PR) 88are input into the CPU 2 by the user via input device 5. Returning toFIG. 3, the DR 84 at block 302D, the PR 88 at block 302E, and the QIID44 at block 302C are illustrated as components of a "data/info unit"(DU) 80 at block 302B. The DU 80, which is a component of the RFM 68illustrated at block 302, will now be described.

The DU 80 is the primary element of data and information in the presentinvention. It may be comprised of various types of responses to the QI32. One type of response is the DR 84, which is an element ofinformation and/or data input into the CPU 2 by the user via the inputdevice 5 in response to the QI 32. Another type of response is the PR88, which is an element of information and/or data input into the CPU 2via the input device 5, which does not require direct input by the user.A few examples of PRs 88 are the length of time it took to enter the DR84 in response to the QI 32, the current date and time and, if thecomputer is equipped with biological measurement equipment (such asbiofeedback apparatus), the user's current heart rate, galvanic skinresponse, and other biologic measures. In the preferred embodiment ofthe present invention, one DR 84 that has been elicited by a QI 32 andthe associated QIID 44 are the only required elements of the DU 80. Theinclusion of PRs 88 is optional. In alternate embodiments, there may beone or a plurality of PRs 88 with no DR 84, there may be one or aplurality of QIs 32 that elicit PRs 88 (such as showing a person aprovocative picture to elicit an autonomic response), there may be no QI32 (such as collecting electrocardiogram readings on a resting patient),and there may be no QIID.

At step 213, each DR 84 and PR 88 of the DU 80 in focus is checked fortheir format validity by the CPU 2 via programming code of the DCCM 24.Returning again to FIG. 5 at block 502D, the aforedescribed responsevalidation code (RVC) 92 is used by the CPU 2 to determine whether theDR 84 and PR 88 are in an acceptable format for each QI 32 with which itis associated. The RVC 92 is comprised of alphanumeric code thatindicates the valid format of each DR 84 and PR 88. A validated DU 80contains no invalid DR 84 and PR 88. An invalid DU 80 contains at leastone DR 84 or PR 88 in an invalid format. For example, the RVC 92associated with an QI 32 requesting a person's years of age, mayindicate that the DR 84 greater than the criterion of 130 is invalid.

At step 214 the CPU 2, via programming code of the DCCM 24, notifies theuser of an invalid response via the presentation device 6. Thenotification may be comprised of a visual, auditory, or other suitablecue, signal or sign. In addition, the CPU 2 deletes the invalid DR 84and PR 88 from the RAM device 4 (and any other memory device utilized)and from any display device 6 in which it appears. The process thenreturns to step 212.

At step 215 the CPU 2, via programming code of the DCCM 24, stores eachvalidated DU 80 as digital signals in at least one IRF 40. In thepreferred embodiment of the present invention, the IRF 40 is structuredin an ASCII delimited format with each data element (i.e., the QIID 44and its associated DR 84 and/or PR 88) arranged adjacent to one another.In alternate embodiments, any other suitable data format and dataelements may be utilized.

At step 216 the CPU 2, via programming code of the DCCM 24, stores eachvalidated DU 80 as digital signals in at least one "internal databasefile" (IDF) 100. Note that this step is also indicated in FIG. 7 by thearrow pointing from step 702 to 706. While the IRF 40 contains the DUs80 of a single entity, the IDF 100 contains DUs 80 of a plurality ofentities structured in a manner similar to the plurality of records in aconventional database or multidimensional database. The recordscomprising the IDF 100 may also be interconnected by electronicallylinking at least one of the DRs 84 and/or PRs 88 of specified IRFs 40 toat least one of the DRs 84 and/or PRs 88 of other specified IRFs 40 thathave the same QIIDs 44.

Note that one or both of the steps 215 and 216 need be utilized by thepresent invention; either, but not both, can be disregarded (bypassed,skipped over). That is, the DRs 84 and PRs 88 must be stored in eitherthe IRF 40 or IDF 100, or they can be stored in both.

Also note that error correction routines may be employed by which theCPU 2, via programming code of the DCCM 24, is instructed to replacespecific information and/or data that has been previously stored in theIRF 40 or IDF 100 with new information and/or data entered into theinput device 5.

Returning to FIG. 3, the aforedescribed IDF 100 is at block 302F. TheIDF 100 comprises:

a "table record" (TR) 104 at block 302G, which is comprised of at leastone of the DUs 80 of a single entity that has been stored in the IDF 100as a single record;

an "extended table record" (ETR) 144 at block 302H (described at a laterpoint below); and

an "aggregate data/info unit" ADU 146 at block 3021 (also described at alater point below).

Returning once again to FIG. 2, at step 217 the CPU 2, via programmingcode of the DCCM 24, reads the aforedescribed branching logic code (BLC)112 which is illustrated at block 501D (FIG. 5), the branching criterion(BC) 116 which is illustrated at block 501E (FIG. 5) and the branch-tolocation (BTL) 120 which is illustrated at block 501F (FIG. 5) of theQIH 36. The BLC 112 is comprised of navigation instructions that directthe CPU 2 where to focus after the user inputs a valid response. In thepreferred embodiment, BLC 112 includes alphanumeric code instructing theCPU 2 to go to:

the next QI 32 in the QM 28 regardless of the previous valid response;

the QI 32 specified by the associated BTL 120 regardless of the previousvalid response;

the QI 32 specified by the associated BTL 120 if the previous validresponse is greater than the associated BC 116;

the QI 32 specified by the associated BTL 120 if the previous validresponse is less than the associated BC 116; or

the QI 32 specified by the associated BTL 120 if the previous validresponse is equal to the associated BC 116.

In addition, the BLC 112 instructions above can combined using Booleanlogic elements including the operators "and", "or", "not", "if", "then",and "except".

At step 218 the CPU 2, via programming code of the DCCM 24, focuses onthe QI 32 which is indicated by the branching logic resulting from theprocess of step 217. Note that steps 217 and 218 are optional sincethere is no requirement that the QM 28 contain QUs 30 that utilize theaforedescribed branching process. At step 219 the electronic DCM 20method ends unless there is at least one additional QU 30 in the QM 28.If at least one additional QU 30 exists, the process loops back to step205 and repeats.

Whereas the above describes the electronic DCM 20 method of thepreferred embodiment of the present invention, an alternate embodimentis comprised of the nonelectronic DCM 20 method. In this alternateembodiment, at least one element of information and/or data is obtainedvia nonelectronic means, such as by using paper questionnaires, surveys,and other suitable nonelectronic means for obtaining data andinformation. The nonelectronic DCM 20 utilizes one or a plurality ofnonelectronic QIs 32, each associated with the nonelectronic QIID 44 andRII 56. Data and information obtained using the nonelectronic DCM 20method can be input into the apparatus 1 via the input device 5, usingan optical scanner, keyboard or other suitable input device. This isinput process is similar to step 215 (FIG. 2) of the preferredembodiment, except that both valid and invalid DUs 80 are stored in theapparatus 1 and, further, different input means may be used.

The nonelectronic DCM 20 method is comprised of additional steps whichare similar to the electronic DCM 20 method. Returning to FIG. 2 at step213, since each DR 84 and PR 88 are converted to digital signal formupon being input into the apparatus 1, the format of each DR 84 and PR88 can be validated by the CPU 2, via programming code of the DCCM 24.This format validation process is comprised of instructing the CPU 2 tocompare the formats of all input DRs 84 and PRs 88 to criteria which arebased on associated RIIDs 72. Thus, code of the DCCM 24 of thenonelectronic DCM 20 may instruct the CPU 2 to identify each DR 84 andPR 88 that fails to have the proper format for the RIID 72 with which itis associated. For example, if at step 214 the RIID 72 instructs the enduser to respond with a "yes or no", but the user's DR 84 is "Disagree",then the CPU 2 may present a warning indicator via any suitable meansthat the DU 80 is invalid (such as by displaying its QIID 44 in a listof invalid responses presented on the presentation device 6). The CPU 2may also delete the invalid DU 80. Unlike the electronic DCM 20 method,however, an invalid DU 80 does not return the process to step 212.

Step 216 is also similar in both the electronic DCM 20 and nonelectronicDCM 20 methods. Steps 217, 218, and 219, however, are not components ofthe nonelectronic DCM 20 method. Instead, when branching is utilized,the user must be informed of the specific BC 116 and BTL 120instructions associated with each QI 32, such as by indicating branchinginstructions in print next to the QI 32 when a written questionnaire isused (e.g., an instruction may say, "If you answered YES to thisquestion, skip the next three questions.").

Thus far, the electronic DCM 20 method of the preferred embodiment andthe nonelectronic DCM 20 method of the alternate embodiment of thepresent invention have been described. The DCM 20 methods describe howdata and information, comprised of DRs 84 and PRs 88, are acquired andstored (i.e., compiled) in the present invention.

A hypothetical example of the electronic DCM 20 method follows. Thisexample illustrates the use of the electronic DCM 20 to obtain data andstore them in the IRF 40 and IDF 100. In this example, a computerapparatus 1 is used to assess mathematical (computational) skills in astudent over time (i.e., longitudinally) utilizing QM 28 number "1115".In this example, the entire DCM 20 process below is repeated at twodifferent points in time, using the same QM 28 with the same student.The first time the QM 28 is utilized is the "initial assessment" and thesecond time is the "final assessment".

Referring to FIG. 2, the evaluator (i.e., the person evaluating thestudent) types in "1115" in the computer keyboard input device 5 at step201 and then types in the student's social security number at step 202.The CPU 2, via programming code of the DCCM 24:

encrypts the social security number, returning the alphanumeric string"A77H49";

names the IRF 40 "A77H49.001" for the initial assessment and"A77H49.002" for the final assessment at step 203; and

locates QM 28 number 1115 at step 204.

The QM 28 in the present example is comprised of one hundred QUs 30. TheQUs 30 are arranged in a sequential order in which every ten QUs 30refer to the same computational process, but no two groups refer to thesame computational process (e.g., the first ten QUs 30 are additionproblems, the second ten are subtraction problems, etc.).

The CPU 2, via programming code of the DCCM 24, then:

reads the QIH 36 of the first QU 30 at step 205;

at step 206 it writes the QIID 44 to the presentation device 6;

at step 207 it reads the QI 32;

at step 208 it writes the QI 32 to the presentation device 6, in a bold,centered, Arial 12 point font format, as indicated by the QIFC 48,thereby presenting a computational problem on the computer monitor;

at step 209 it reads the RIC 64;

at step 210 it searches the RIH 60 for a match between the RIID 72 andRIC 64;

at step 211 it writes the RII 56 to the presentation device 6, in abold, centered, Arial 12 point font format beneath the QI 32 asindicated by the RIFC 76, which instructs the student to type on thekeyboard the answer to the QI 32 or type "DK" if he does not know theanswer, and

then writes the input prompt, comprised of a one inch line below to thepresentation device 6, as indicated by the IPC 78.

The student then responds to the QI 32 by typing in his DR 84 at step212. At step 213 each DR 84 is checked (validated) by the CPU 2 viaprogramming code of the DCCM 24 and the RVC 92 to ensure it is either anumeral or the letter "DK". If the DR 84 is invalid the CPU 2, viaprogramming code of the DCCM 24, sounds a warning beep and the DR 84 isdeleted at step 214. At step 215 the CPU 2, via programming code of theDCCM 24, saves each validated DR 84 and its associated QIID 44 as the DU80. These validated DUs 80 are saved in an initial or final assessmentIRF 40 (which ever is appropriate) within storage device 8. The IRF 40is in ASCII tabbed-delimited format with the QIID 44 to the left and itsassociated DR 84 single-tabbed to its right. At step 216 the CPU 2, viaprogramming code of the DCCM 24, saves each DR 84 and its associatedQIID 44 (as its field) as an element in the TR 104 in a table in aMicrosoft Access IDF 100 in storage device 8. The TR 104 is assigned theID number A77H49 as the primary key. The initial assessment DRs 84 aresaved in one table and the final assessment DRs 84 in a second table.

To make the presentation of QUs 30 more efficient, the CPU 2, viaprogramming code of the DCCM 24, executes a branching routine at step217 and 218. The branching routine utilizes the BLC 112, BC 116 and BTL120 in the QIH 36 of every tenth QU 30 (beginning with the first) toinstruct the CPU 2 to skip the following nine QUs 30 if the student's DR84 is "DK" and then resume with the next QU 30 (e.g., if "DK" is the DR84 to QU 30 number 20, then the next QU 30 to be presented would benumber 30). Steps 205 through 218 are repeated until the QM 28 iscompleted. Note that this hypothetical example will hereinafter bereferred to as the "computational skill example". Further description ofthis example will be postponed until it is continued at a later pointbelow. Attention is now turned to describing how the method of thepresent invention processes at least one element of information and/ordata and generates reports.

FIG. 6 illustrates an operational flow diagram of the steps of themethod used in the present invention to process at least one element ofinformation and/or data and to generate reports (i.e., the "processingand reporting method"). The processing and reporting method, which isinitiated at step 600, is utilized to process and report at least oneelement of information and/or data compiled via the electronic DCM 20and nonelectronic DCM 20 methods. The data and information processingcomponent of the processing and reporting method utilizes a "data/infoprocessing module" (DPM) 124. Note that if the DCM 20 method is notutilized and, instead, information and/or data are obtained via adifferent method and stored in other than the IRF 40 or IDF 100, thensteps 601 through 604 are skipped, and the process resumes at step 605(as will be described at a later point below).

Returning again to FIG. 3, the DPM 124 is at block 303. The DPM 124comprises:

a "data/info processing code module" (DPCM) 128 at block 303A;

a "data/info processing function/formula module" (DPFM) 132 at block303B;

a "data/info retrieval and processing file" (DRPF) 136 at block 303C;

a "processed data/info file" (PDF) 140 at block 303D; and

a "data/info integration file" (DIF) 154 at block 303E.

The DPCM 128 is comprised of one or a plurality of files containingprogramming code that operate the DPM 124 via instructions to the CPU 2.The programming code may be written in any suitable programminglanguage. The DPFM 132 is also comprised of one or a plurality of filescontaining a single function and/or formula or a plurality of functionand/or formulas that give the CPU 2 instructions for processing at leastone element of information and/or data. The functions and formulasutilized by the DPFM 132 may include financial, mathematical,trigonometry, statistical, logical, lookup, reference, text, database,date and time, and all other functions and formulas utilized by acomputer processing text and/or images and/or sounds and/or numbers.

Returning to FIG. 6, at step 601, the CPU 2, via programming code of theDPCM 128 and formulas and/or functions of the DPFM 132, retrieves DUs 80from the IRF 40 and return them to the DRPF 136. The DRPF 136 is a filecontaining DPFM 132 formulas and/or functions which are utilized, inconjunction with DPCM 128 code, to retrieve and processes the DUs 80from the IRF 40. The retrieval process can be accomplished byreferencing, copying, importing, "linking" (i.e., making digital signalconnections between elements) and/or by using any other suitable meansfor accessing or linking to DUs 80 from within the IRF 40. Note thatthis process is also indicated in FIG. 7 by the arrow pointing from step702 to step 704.

At step 602 the CPU 2, via programming code of the DPCM 128 and formulasand/or functions of the DPFM 132, performs the specified formula and/orfunction routines on the retrieved DUs 80 in the DRPF 136. Theseformulas and/or functions perform at least one of the following routineson at least one element of the data or information: mathematicalanalyses, logical analyses, format modification, arrangement intospecified formations, and any other suitable analysis and organizationformulas and/or functions. If desired, a suitable spreadsheet programcan utilize a single spreadsheet or plurality of linked (interconnected)and/or independent spreadsheets to perform these formula and/or functionroutines.

The formula and/or function routines generate one or a plurality of PDFs140. The PDF 140 is a file comprised of one or a plurality ofinformation and/or data elements retrieved by the DRPF 136 at step 601and processed by the DRPF 136 at step 602. Note that this process isalso indicated in FIG. 7 by the arrow pointing from step 704 to step705. The information and/or data elements in the PDF 140 are arranged inhorizontal and vertical grid-like formations (such as a continuoustic-tac-toe design) and/or other suitable formations. The actuallocation, format, and content of the information and/or data elementsare determined by formulas and/or functions in the DRPF 136 and code inthe DPCM 128. DRPF 136 templates may be utilized in which the formulasand/or functions are organized into predetermined formations. Theseformations facilitate information and/or data processing and reporting,as discussed below. The values comprising these formations are saved toa one or plurality of PDFs 140, which serve as an intermediate means ofdata/information formation storage and a convenient and efficient meansfor transmission of the data/information formations. The PDF 140 can bestored in any format that preserves the data/information formations andcan be assigned any name that enables the file to be later accessed andits contents retrieved for further processing.

The computational skill example above will again be used to illustratethe data/information retrieval, analysis, and formation routines of theprocessing and reporting method of the present invention. Uponcompletion of the DPM 124 at step 601 the CPU 2, via programming code ofthe DPCM 128 and formulas and/or functions of the DPFM 132, retrievesthe DUs 80 from the student's IRFs 40 and returns them to the DRPF 136.In this example, the DPCM 128, DPFM 132, DRPF 136 are all contained in aMicrosoft Excel "workbook", which is comprised of at least one ofspreadsheets, macros, and Visual Basic modules that are saved as asingle file in storage device 8. The DUs 80 are retrieved using a VisualBasic copy command from the DPCM 128 and lookup and reference formulasand/or functions of the DPFM 132. Note that since Visual Basic commandsand Excel functions and formulas are generally known to persons skillfulin Visual Basic and Excel spreadsheet programming, and since there may aplurality of suitable ways in which the code, functions, and formulasmay be written, the specific alphanumeric content and structure will notbe described in detail herein.

The commands, functions, and formulas instruct the CPU 2 to open andactivate the initial assessment IRF 40 (named A77H49.001) and the finalassessment IRF 40 (named A77H49.002), to retrieve the DUs 80 and QIIDs44 from the IRFs 40, and to a arrange them into a three-column array ina specific, logically determined location in the DRPF 136 spreadsheet.

The first column of the array contains the QIIDs 44 of each DU 80, eachQIID 44 in a subsequent, adjacent row. Note that each QIID 44, DU 80,and Excel formula and/or function in the spreadsheet are located at anintersection between a row and column, in what is known in spreadsheetterminology as a "cell". The cells in the second (adjacent) columncontain the DRs 84 from the initial use of the DCM 20, each DR 84 in acell adjacent to its associated QIID 44. In the third column (adjacentto the initial DRs 84) are the DRs 84 obtained via the final (second)time the DCM 20 was used. The DUs 80 in the DRPF 136 are processed atstep 602, via programming code of the DPCM 128 and formulas and/orfunctions of the DPFM 132, thereby generating the PDF 140, which is alsoan Excel spreadsheet. Following is a detailed description of thisprocessing routine as it applies to the present example.

A fourth, fifth, and sixth column of cells have been previously enteredinto the DRPF 136 spreadsheet as a template for arranging and processingthe DUs 80 retrieved above. The fourth column of cells, which areadjacent to the third, contain the correct answer for each DU 80 innumeric form. Cells in the fifth column, which are adjacent to thefourth, contain an Excel formula that instructs the CPU 2 to compareeach initial DR 84 to its corresponding correct answer and, if they areequal, to return the value of "1" in that cell, or else to return azero. Cells in a sixth column, adjacent to the fifth, contain Excelfunctions that instruct the CPU 2 to compare each final DR 84 to itscorresponding correct answer and, if they are equal, to display thevalue of "1" in that cell, or else to display a zero. Cells at thebottom of fifth and sixth columns are comprised of Excel formulas thatinstruct the CPU 2 to compute and return the sum total of eachrespective column, which represent the total number of correct initialand final DRs 84, respectively. A cell to the immediate right of thecell with the final correct sum total contains an Excel formula thatinstructs the CPU 2 to subtract the initial sum from the final sum toreturn an "actual change score" value. A positive value in the changescore cell indicates an improvement in computational skill over the timeperiod between the initial and final assessments and a negative valueindicates worsening of the skill. Next, the values in the DRPF 136 aresaved as an Excel spreadsheet PDF 140 via a Visual Basic driven Excel"copy-paste special-values" function. Further description of thisexample will be postponed until it is continued below.

Returning to FIG. 6, at step 603, which is an optional step, the CPU 2,via programming code of the DPCM 128, appends and/or links some or allof the information and/or data in the PDF 140 to the aforedescribed TR104, in an aforedescribed IDF 100 to which it is associated. Thisprocess is also indicated in FIG. 7 by the arrow pointing from step 705to step 706. This routine adds processed information and/or data to theDRs 84 and PRs 88 in the IDF 100 to produce the ETR 144. The ETR 144 isanalogous to a record in a table in a database in which the record'sfields are comprised of at least one DR 84, PR 88, and an element ofinformation and/or data processed by the PDF 140. The single ETR 144 maybe comprised of appended information and/or data elements in the singleIDF 100 table or it may be comprised of a plurality of "joined" tables(joined tables are electronically associated or interconnected using aprimary key field to relate them to one another, thereby enabling theinformation and/or data elements of each table to be brought together soactions can be performed on them as though they are a single table).Note that if step 603 is skipped, the process immediately goes to step605.

At step 604, which is also an optional step, the CPU 2, via programmingcode of the DPCM 128 and formulas and/or functions of the DPFM 132,performs database calculations (which may include sums, averages,minimums, maximums, counts, standard deviations, variances, and othersuitable calculations), groupings, filters, sorts, queries, and othersuitable database analysis functions and formulas utilizing two or moreETRs 144 and/or TRs 104 within the IDF 100 or a plurality of linked IDFs100. If desired, a suitable database program can be utilized to performsthese database formulas and functions. The database formulas and/orfunctions produce one or a plurality of ADUs 146, which are comprised ofinformation and/or data elements that can be used to determinepercentile ranks, ranges, frequency distributions, and other suitablestatistical and mathematical data and information. Note that thestatistical and mathematical computations that generate ADUs 146 providea means by which to determine and utilize a plurality of "norms", whichare values representing standards, models or patterns regarded astypical for a specified set of conditions.

The database processing routines in step 604 may be executed:

every time any new ETR 144 is produced;

every time a specific new ETR 144 is produced;

every time a specific plurality of new ETR 144 are produced;

at any other suitable interval of time; or

when the criteria of any other suitable condition is met.

The IDF 100 referred to in steps 603 and 604 is also indicated in FIG. 7at step 706. An additional optional step that may follow step 604, whichis not shown in FIG. 6, is instead indicated in FIG. 7 as step 707. Step707 indicates the utilization of an aforedescribed online analyticprocessor (OLAP), aforedescribed artificial intelligence (AI) program,and any suitable statistics program (SP) such as SPSS (by SPSS, Inc.)and EQS (by Multivariate Software, Inc.). These data and informationanalysis routines access IDF 100 data, analyze them and, as indicated bythe arrow pointing from step 707 to step 709, return the results oftheir analyses to one or a plurality of DIFs 154 as described below.Note that even though only OLAPs, AI programs, and statistics programsare indicated in FIG. 7 at step 707, any current or future technologythat accesses data from databases, analyzes and/or organizes them, andproduces information suitable for inclusion in the DIF 154 may beutilized at this step in the present invention. Note also that thesedata and information analysis routines can also be utilized to generate"factor profiles" which indicate correlated groupings of data via factoranalysis and similar statistical procedures and can be used to reducecomplex data into a smaller number of meaningful concepts.

Step 605 is an additional optional step if the DCM 20 is utilized and anecessary step if the DCM 20 is not utilized. At step 605 the CPU 2, viaprogramming code of the DPCM 128 and formulas and/or functions of theDPFM 132, integrates (merges, combines) information and/or datacomprising the PDFs 140 with any combination of information and/or datafrom:

(a) one or a plurality of the aforedescribed TRs 104;

(b) one or a plurality of the aforedescribed ETRs 144;

(c) one or a plurality of the aforedescribed ADUs 146;

(d) one or a plurality of"reference data/info files" (RDFs) 152 at step606; and

(e) one or a plurality of"external database files" (EDFs) 156 at step607.

This data and information integration routine proceeds within one or aplurality of DIFs 154. The DIF 154 is a file comprised of one or aplurality of grid-like structures or other suitable structures in whichat least two elements of information and/or data can be integrated byarranging their locations to form unified patterns. The DIF 154 may becomprised of the actual DPFM 132 formulas and/or functions and/or mayreceive the values resulting from formulas and/or functions located indifferent DPFM 132 files via copying and/or linking commands of the DPCM128. If desired, a suitable spreadsheet program can utilize algorithmsin a single spreadsheet or plurality of linked (interconnected) and/orindependent spreadsheets, along with suitable programming code, toorganize the information and/or data into suitable patterns.

Returning to FIG. 3, a "supplemental data/info module" (SDM 150),illustrated at block 304, is comprised of the RDF 152 at block 304A (andstep 708 in FIG. 7) and the EDF 156 at block 304B (and step 703 in FIG.7). RDFs 152 and EDFs 156 may be stored in the storage device 8 of theapparatus 1 in which the DIF 154 is located and/or in externalelectronic storage device connected to the apparatus 1 via a LAN or WAN.

The RDF 152 is a file comprised of information and/or data in digitalsignal form that is related to at least one element of informationand/or data in the PDF 140 or its associated IDF 100 (if one isutilized). The RDF 152 may comprise one or plurality of electronictables, "electronic libraries" or any other suitable means for storingand retrieving data and information. Unlike typical databases whichcontain only data elements and/or small units of information, RDFs 152can be comprised of more elaborate forms of information such asparagraphs or pages of text and relatively complex graphics, as well astables of data elements.

The EDF 156 is any type of database "external" to the present invention(i.e., a remote database). That is, EDFs 156 are comprised ofinformation and/or data not compiled by the DCM 20 method. Theinformation and/or data in the EDF 156 can be stored in databases,spreadsheets, and any other suitable form of storage. EDF 156information and/or data can be retrieved and returned to specifiedlocations in the DIF 154 via any suitable programming code of the DPCM128 and formulas and/or functions of the DPFM 132. If desired,programming code, such as "standard query language" (SQL), can beutilized to retrieve specific information and/or data elements from theEDF 156, and spreadsheet reference formulas and/or functions can beutilized to position the elements in specific locations in aspreadsheet. Note that step 607 is also indicated in FIG. 7 by the arrowpointing from step 703 to 709. Also note that information and/or datafrom the DIF 154 can be added to the EDF 156, via any suitableprogramming code of the DPCM 128 and formulas and/or functions of theDPFM 132, as indicated in FIG. 7 by the arrow pointing from step 709 to703.

If the DCM 20 method is not utilized and, instead, information and/ordata obtained via a different method are stored in the EDF 156, anyrecord or records in the EDF 156 may be converted to the IRF 40 byinstructing the CPU 2, via at least one of programming code of the DPCM128 and formulas and/or functions of the DPFM 132, to query, copy, link,or use other suitable routines to put selected information and/or dataelements and their associated field definitions from that record into asingle digital signal file. The file can then be saved to storage device8 with a name that identifies to whom the record belongs and the filecan then be utilized as the IRF 40. If, on the other hand, the DCM 20method is utilized to construct the IRF 40, a similar EDF 156 to IRF 40conversion process may be utilized to append information and/or datafrom the EDF 156 to the IRF 40.

The EDF 156 to IRF 40 conversion is illustrated in FIG. 7. At step 701the aforedescribed QM 28 is utilized to acquire information and/or data.At step 702, the QM 28 saves the information and/or data in the IRF 40.At step 703, the arrow pointing from step 703 to step 702 indicates theEDF 156 to IRF 40 conversion process as described above, while the arrowpointing from step 703 to step 709 indicates the aforedescribedintegration of EDF 156 data into the DIF 154 (as depicted at step 607 ofFIG. 6). Note that if the DCM 20 method is not utilized, the initialstep is 703 and the next step is 702.

An additional database to IRF 40 conversion process is available whenthe DCM 20 method is utilized. This process involves storing theinformation and/or data acquired via the DCM 20 method in theaforedescribed IDF 100 and putting selected information and/or dataelements and their associated field definitions from one or morespecified records into a single digital signal file utilizing a routinesimilar to the EDF 156 to IRF 40 conversion process describedimmediately above. The file can then be saved to storage device 8 with aname that identifies to whom the record belongs and the file can then beutilized as the IRF 40. This process is illustrated in FIG. 7 by thearrow pointing from step 706 to step 702.

The above hypothetical "computational skill example" will now beelaborated upon to illustrate how to utilize Microsoft Excel and Accessprograms to:

(a) add the DRs 84 from the IRF 40 to the TR 104;

(b) produce ETRs 144 by adding data from the PDF 140 to an associated TR104;

(c) produce ADUs 146 from the ETRs 144; and

(d) integrate the data and information that comprise the PDF 140, ETR144, ADU 146, RDF 152, and EDF 156 via the DIF 154.

The process begins by using Visual Basic code to copy the DRs 84 storedin the student's initial assessment IRF 40 to their associated fields inthe TR 104 in a table named "initial assessment" in a Microsoft AccessIDF 100 as per step 215 (in FIG. 2) and the arrow pointing from step 702to step 706 (in FIG. 7). In addition, the DRs 84 stored in the student'sfinal assessment IRF 40 are copied in the same manner to theirassociated fields in the TR 104 in a table named "final assessment" inthe same Access IDF 100. Next, as per step 603 (in FIG. 6) and the arrowpointing from step 705 to step 706 (in FIG. 7), Visual Basic code isused to copy the initial and final assessment total correct values andthe actual change score value from the student's PDF 140 to a thirdtable named "totals" in the same IDF 100. Note that the student'srecords in the three tables have the student's ID number (A77H49) as theprimary key. Furthermore, the tables are linked via standard Accesstable-linking functions, thereby producing the ETR 144. Note that inthis example, ETRs 144 from a plurality of students have previously beenadded to the IDF 100 tables.

At step 604 (in FIG. 6) the IDF 100 totals and actual change score tableare analyzed statistically via Access query calculations to yieldaggregate means (averages) and standard deviations for the two totalcorrect values and the actual change score value of all the studentsaggregated together. These calculated values comprise the ADUs 146.

At step 605 the DIF 154, comprised of a Microsoft Excel workbook file,is used to integrate a plurality of sources containing data andinformation. To begin, Visual Basic code and Excel formulas andfunctions in the DIF 154 instruct the CPU 2 to copy the PDF 140 valuesto a spreadsheet in the DIF 154 named "DATA". Further Visual Basic codeand Excel formulas and functions then drive the following process toexpand the aforedescribed six column array of the PDF 140 which nowresides in the DATA spreadsheet.

First, the ADUs 146 calculated above are imported to the DIF 154 DATAspreadsheet from the IDF 100 using Excel's "get external data" process,which utilizes an "open database connectivity" (OBDC) driver, "dynamicdata exchange" (DDE) mechanisms, and SQL code. This process places the:

(a) aggregate mean value of the initial assessment total correct scorein the DIF 154 DATA spreadsheet cell immediately below the initial totalscore;

(b) standard deviation value of the initial assessment total correctscore in the cell immediately below its aggregate mean value;

(c) aggregate mean value of the final assessment total correct score inthe cell immediately below the final total score;

(d) standard deviation value of the final assessment total correct scorein the cell immediately below its aggregate mean value;

(e) aggregate mean value of the actual change score in the cellimmediately below the final total score; and

(f) standard deviation value of the actual change score in the cellimmediately below its aggregate mean value.

Excel formulas and/or functions located immediately below the standarddeviation cells then instruct the CPU 2 to calculate z-scores (astatistic used to calculate percentile rankings, which computes thedifference of an individual score from its aggregate mean in terms ofstandard deviation units) by:

(a) subtracting the initial and final assessment total correct scorevalues from their respective aggregate means; and

(b) dividing each difference value by its respective standard deviationvalue.

Next, Excel lookup functions in cells in the next row down search an RDF152 z-score conversion table (used to convert z-scores to percentilerankings), which is located in another spreadsheet in the DIF 154workbook, to match each z-score in columns five through seven and returnthe corresponding percentile value.

In addition, in the present example there is a hypothetical RDF 152which is comprised of research-based information obtained via use of theDCM 20 to assess the effect of a mathematics enrichment program. The RDF152 is a Microsoft Word document containing text describing the natureand implication of the research as well as an ASCII tab-delimited tableof values indicating the average change score obtained at every level ofinitial total correct values. In the present example the student had aninitial total correct value of 8 and final total correct of 12 for again of 4 points. According to the RDF 152 table, an average gain of 3points for a student with an initial total correct value of 8 isexpected following the enrichment program. Thus, the value of 3 pointsis the "expected change score." Using an Excel "object linking andembedding" (OLE) function, the aforedescribed ASCII tab-delimited tableof values are continuously linked to a third spreadsheet in the DIF 154workbook named "RDFLINK". And using an Excel lookup function, theexpected change score value of 3 is returned from the RDFLINKspreadsheet to a specified cell in the DATA spreadsheet.

In addition, the EDF 156 comprised of other data about the student andother students is included in this example. The EDF 156 contains aprimary field with each student's ID number and other fields indicatingthe student's age, grade level, sex, and IQ. Using Excel'saforedescribed "get external data" process, the student's age, gradelevel, gender, and IQ values are retrieved and returned to specifiedcells in the DATA spreadsheet. Further description of this example willbe postponed until it is continued below.

Returning again to FIG. 6, at step 608 one or a plurality of"portablereport data/info files" (PRDFs) 164 are saved to storage device 8 by theCPU 2 via programming code of the DPCM 128. Note that step 608 is alsoindicated in FIG. 7 at step 710. The PRDF 164 is comprised of at leastone element of the information and/or data in the DIF 154 and/or PDF140. For consistency of file names, the name of the PRDF 164 may beassigned the encrypted name of the IRF 40 (as per step 203 in FIG. 2),but with a different extension to avoid overwriting the IRF 40 with thePRDF 164, or the PRDF 164 may be assigned any other suitable name. ThePRDF 164 may be saved in any suitable file format that maintains thedata structures including, but not limited to, any suitableASCII-delimited format such as comma or tab delimited. The PRDF 164 mayalso be compressed using any suitable compression process, such asPkZip, to reduce the amount of storage device 8 space needed to storeit. Note that any files in the present invention may likewise becompressed in a suitable manner and decompressed prior to beingutilized. Note that error correction routines may be employed by whichthe CPU 2, via programming code of the DPCM 128, is instructed toreplace specific information and/or data that has been previously storedin the PRDF 164 with new information and/or data entered into the inputdevice 5.

The PRDF 164 is a component of a "report generation module" (RGM) 160.The RGM 160, which is illustrated in FIG. 3 beginning at block 305,comprises:

(a) the aforedescribed PRDF 164 at block 305A;

(b) a "report generation code module" (RGCM) 168 at block 305B, which isdescribed below;

(c) a "report generation function/formula module" (RGFM) 172 at block305C, which is described below; and

(d) a "report format file" (RFF) 176 at block 305D, which is alsodescribed below.

Returning again to FIG. 6, at step 609 the CPU 2 utilizes theinformation and/or data in the PRDF 164 to generate printed andelectronic reports, via instructions from programming code of the RGCM168 and formulas and/or functions of an RGFM 172. The RGCM 168 iscomprised of one or a plurality of files containing programming codethat operates the RGM 160 via instructions to the CPU 2. The programmingcode may be written in any suitable programming language. The RGFM 172is also comprised of one or a plurality of files containing a singleformula and/or function or a plurality of formulas and/or functions thatgive the CPU 2 specific instructions for processing at least one elementof information and/or data used in generating a report. The formulasand/or functions utilized by the RGFM 172 may include financial,mathematical, trigonometry, statistical, logical, lookup, reference,text, database, date and time, and any other suitable formulas and/orfunctions performed by a computer. The formulas and/or functions of theRGFM 172 may be linked to and/or stored in one or a plurality of RFFs176. The RFF 176 is a file, located in storage device 8 of the apparatus1 of the present invention and/or in a suitable remote storage device,which may:

(a) contain the actual RGFM 172 formulas and/or functions; and/or

(b) receive the values resulting from formulas and/or functions locatedin different RGFM 172 files via copying and/or linking commands of theRGCM 168; and/or

(c) contain one or a plurality of pre-established templates ofalphanumeric text and/or graphics and/or sound objects.

Note that the PRDF 164 provides and efficient means by which to transmitdata and information in report ready form. Furthermore, since the PRDF164 is independent of the RFF 176, the programming code, formulas,functions, alphanumeric text, graphics, and visual and sound objects inthe RFF 176 may be modified at any time without adversely affecting thecontents or structure of the PRDF 164. Thus, the PRDF 164 retains itsintegrity and usefulness even if it is:

(a) transferred out of the storage device containing the RFF 176; or

(b) transferred from an external storage device (including a floppydisk, tape, LAN, WAN or any other suitable means for storing andtransferring digital signal files) back to where the RFF 176 is stored.

Operating in conjunction with the RFF 176, the programming code of theRGCM 168 and formulas and/or functions of the RGFM 172 instruct the CPU2 to generate output reports by presenting specified information and/ordata from the PRDF 164 to the presentation device 6. The CPU 2 may, forexample, be instructed to generate a report by:

(a) placing information and/or data from the PRDF 164 to specificlocations in the RFF 176;

(b) sorting the information and/or data in the RFF 176 (e.g.,alphabetically, numerically);

(c) filtering (i.e., hide) specific PRDF 164 information and/or data;

(d) preparing specific PRDF 164 information and/or data in graphic,pictorial, auditory form and/or any other suitable form;

(e) using specific font sizes, styles, and alignments, page and marginsizes, page headers and footers, and numeric format (e.g., number ofdecimal places to be displayed) in specified portions of an alphanumerictext;

(f) using specific colors and styles for the symbols used in graphs,still pictures, and videos;

(g) using specific volumes of sound objects; and/or

(h) using any other suitable report generating processes.

Note that in addition to the information and/or data from the PRDF 164,information and/or data from any EDF 156 and RDF 152 may be retrievedand returned to the RFF 176 by the CPU 2 via programming code of theRGCM 168 and formulas and/or functions of the RGFM 172. While theseroutines are not shown in FIG. 6, they are indicated in FIG. 7, wherein:

(a) the arrow pointing from step 703 to step 711 indicates the placementof EDF 156 information and/or data into the RFF 176; and

(b) the arrow pointing from step 708 to step 711 indicates the placementof RDF 152 information and/or data into the RFF 176.

At step 610, the CPU 2 via instructions from programming code of theRGCM 168, outputs the report generated at step 609 to the output device7. The data and information processing and reporting routine terminatesat step 611. Note that the report generation routine comprising steps609 and 610 may be repeated any number of times to generate a pluralityof reports utilizing at least one of:

(a) a plurality of different PRDFs 164 with a single RFF 176;

(b) a plurality of different RFFs 176 with a single PRDF 164;

(c) a plurality of different PRDFs 164 with a plurality of differentRFFs 176; and

(d) any of the three options above with the inclusion of informationand/or data from one or a plurality of EDFs 156, one or a plurality ofRDFs 152 or both.

The above hypothetical "computational skill example" will now beelaborated upon to illustrate how Microsoft Excel and Access programscan utilize the PRDF 164, RGCM 168, RGFM 172, and RFF 176 to generateand output a report. The routine involves a series of steps during whichthe CPU 2 utilizes instructions from Excel Visual Basic modules (whichcomprise the RGCM 168) and formulas and/or functions in Excelspreadsheets (which comprise the RGFM 172).

The process begins at step 608 as the CPU 2, via Visual Basic code,copies the values of select cells in the Excel "DATA" spreadsheetcomprising the DIF 154 to a spreadsheet (assigned the name "A77H49")comprising the only spreadsheet in an Excel workbook (assigned the name"A77H49.XLS") which is saved as the PRDF 164. The cell values that arecopied from the DIF 154 DATA spreadsheet cells to the PRDF 164spreadsheet cells are:

(a) the total number of correct initial DRs 84 and the correspondingpercentile rank;

(b) the total number of correct final DRs 84 and the correspondingpercentile rank;

(c) the change score;

(d) the value of "3" referring to the average units of change followingthe enrichment research program; and

(e) the student's age, grade level, sex, and IQ which were obtained fromthe EDF 156. The PRDF 164 is now complete.

At step 609 a report is generated utilizing the cell values in the PRDF164 in conjunction with Visual Basic code comprising the RGCM 168, Excelspreadsheet formulas and/or functions comprising the RGFM 172 and anExcel workbook comprising the RFF 176. The description of this reportgeneration process follows below.

The end user begins by typing, via the input device 5, the student'sencrypted ID number in a cell in the first RFF 176 spreadsheet name"ID". The cell had been previously formatted with a line border aroundit and adjusted to a suitable height and width using Excel mouse andkeyboard operations. In the cell to the immediate left the text "Pleaseenter the student's ID number to the right and press Enter. Next, clickon the START button below." When clicked with the mouse, the startbutton, which was previously created via the Excel "dialog sheet" andassigned a Visual Basic procedure, initiates the Visual Basic procedurethat instructs the CPU 2 to:

(a) find and activate the PRDF 164 with the name "A77H49.XLS" fromwithin the storage device 8 in which it is stored;

(b) copy the PRDF 164 spreadsheet values to a spreadsheet named "VALUES"in the RFF 176 workbook; and

(c) retrieve the contents of the VALUES spreadsheet and return them tospecified cells in another RFF 176 workbook spreadsheet named "REPORT"via use of linking formulas in the cells of the REPORT spreadsheet.

The resulting pattern of values in the RFF 176 REPORT spreadsheet,together with previously entered text in text label cells, comprise analphanumeric text report. The content and structure of the REPORTspreadsheet is as follows:

The text label "Student's ID:", which was previously entered into thespreadsheet, is in the first cell (i.e., the cell to the extreme upperleft) and the student's ID number is in the cell to its immediate right.

The text label "Today's Date:", which was previously entered into thespreadsheet, is in the cell beneath the "Student Student's ID:" labeland a formula that returns the current date, which was also previouslyentered into the spreadsheet, is in the cell to its immediate right.

The text labels "Age:", "Grade:", "Gender:", and "IQ:", which waspreviously entered into the spreadsheet, are located in a single columnwith each label in a cell immediately beneath the one above it. Thefirst label (i.e., "Age:") located two cells beneath the "Today's Date:"cell. The student's age, grade level, and IQ values are returned tocells the immediate right of their respective label cells.

In the cell two cells below the "IQ:" label is the previously enteredtext, "Mathematical Computation Evaluation Results", formatted in boldand underlined.

Beginning in the cell two cells below and one cell to the right of the"Mathematical Computation Evaluation Results" label cell is a cell withthe text label "Percentile" and a cell to its right with the text label"Raw Score:".

The cell immediately below and one cell to the left of the "Percentile"text label cell is a cell with the text label "Initial Score:".

The cell immediately to the right of the "Initial Score:" text labelcell contains a linking formula that returns from the cell in the VALUESspreadsheet the total initial correct percentile value.

The cell immediately to the right of the correct initial percentilevalue cell contains a linking formula that returns from the cell in theVALUES spreadsheet the total initial correct raw score value.

The cell immediately below the "Initial Score:" text label cell is acell with the text label, "Final Score".

The cell immediately to the right of the "Final Score:" text label cellcontains a linking formula that returns from the cell in the VALUESspreadsheet the total final correct percentile value.

The cell immediately to the right of the correct final raw score valuecell contains a linking formula that returns from the cell in the VALUESspreadsheet the total final correct raw score value.

Two cells below and one cell to the right of the "Final Score:" textlabel cell is a cell with the text label "Actual Change Score:".

The cell immediately to the right of the "Actual Change Score:" textlabel cell is a cell containing a linking formula that returns from thecell in the Data spreadsheet the raw change score value.

The cell immediately below the "Actual Change Score:" text label cell isa cell with the text label "Expected Change:".

The cell immediately to the right of the "Expected Change:" text labelis a cell containing a linking formula that returns from the cell in theData spreadsheet the expected change score value.

The cell immediately to the right of the expected change score valuecontains a formula instructing the CPU 2 to subtract the expected changescore value from the actual change score value and, if the differencebetween the two scores is:

(a) greater than 0 (zero), to return to the formula cell the text"Change Score is Above Expectations";

(b) equal 0 (zero), to return to the formula cell the text "Change Scoreis As Expected"; and

(c) less than 0 (zero), to return to the formula cell the text "ChangeScore is Below Expectations".

The page setup for the REPORT spreadsheet is portrait orientation,adjusted to fit on one page wide by one page tall, with one inch marginsand no gridlines, headers, nor footers. The width of the columns, heightof the rows, and format of the cell contents are adjusted as necessaryfor suitable appearance.

In addition to the REPORT spreadsheet are two graphs. The graphs werepreviously designed by inserting graph sheets in the RFF 176 using theMicrosoft Excel 5.0 pull-down menu "insert chart as new sheet" commandand then following the instructions of the "ChartWizard".

The ChartWizard process for creating the first graph is as follows:

The "range" are those cells in the REPORT spreadsheet containing thetext labels and corresponding values for the initial and final totalpercentiles.

The chart type is column.

The chart format is option "6" (i.e., includes a Y-axis grid).

The data series is in columns.

"1" is entered into the box indicating the column(s) to be used forlabels.

"1" is entered into the box indicating the row(s) to be used for legendtext.

"No" is indicated under "Add a Legend?".

The chart title is "Student Progress Chart".

The "category axis" title is "Evaluation Designation".

The "value axis" title is "in percentile points".

The ChartWizard process for creating the second graph is as follows:

The "range" are those cells in the REPORT spreadsheet containing thetext labels and corresponding values for the change score and expectedchange score.

The chart type is column.

The chart format is option "6" (i.e., includes a Y-axis grid).

The data series is in columns.

"1" is entered into the box indicating the column(s) to be used forlabels.

"1" is entered into the box indicating the row(s) to be used for legendtext.

"No" is indicated under "Add a Legend?".

The chart title is "Actual versus Expected Change".

The "category axis" title is blank.

The "value axis" title is "in raw score units".

The page setup for charts is landscape orientation, scale to fit page,with one inch margins and no gridlines, headers, nor footers.

The contents of the aforedescribed REPORT spreadsheet and two chartscomprise the three page report of the present example. The report may beviewed on a presentation device 6 and/or printed out via an outputdevice 7. This concludes the use of the computational skill example todescribe aspects of the present invention.

Conclusion, Ramifications, and Scope

Accordingly, the modular system of the present invention overcomes majorlimitations of conventional and multidimensional databases by providinga substantially more flexible and efficient structure by which tocompile, process, transmit, and report data and information.

The modules of query and response instruction items utilized by thepresent invention can readily accommodate a multitude of varied andchanging requests for a multitude of different types of informationand/or data, thereby easily adapting to variable requests for data andinformation over time. Conventional and multidimensional databases aresubstantially less flexible, having a substantially more difficult timeadapting and adjusting to end users changing needs.

The present invention can facilitate the compilation of informationand/or data by utilizing a branching-logic process, thereby enabling asubstantially larger number data and information elements to be compiledin a substantially briefer period of time than can conventional andmultidimensional databases.

The independent record files utilized by the present invention enable amultitude of raw data to be stored in digital signal records containingsubstantially less sparseness and overhead than conventional andmultidimensional databases, thereby requiring substantially less spaceto store them and substantially less time to transmit them viaelectronic means (e.g., LANS and WANS).

The independent record files utilized by the present invention cancontain a multitude of data types in a single field and can havediffering fields from record to record, thereby providing substantiallygreater flexibility and efficiency than provided by conventional andmultidimensional database records.

Any of the modules of data and information, computer programming code,and digital signal functions and formulas utilized by the presentinvention can be readily modified without disrupting the structure orcontent of the other modules, thereby providing substantially greaterflexibility, efficiency, and stability than provided by the rigidlystructured, interdependent components of conventional andmultidimensional databases.

The present invention can integrate and process a multitude of data andinformation from a multitude of sources to create a multitude of digitalsignal patterns which are saved in files utilized to generate reports.These digital signal patterns provide a substantially more flexible andefficient means for storing large quantities of complex data andinformation than by utilizing the linked tables of conventionaldatabases or by utilizing multidimensional databases.

The present invention can utilize a multitude of report format files togenerate customized reports comprised of a multitude of formats andcontents. These reports can be produced with substantially greater ease,flexibility, and computing power than can conventional andmultidimensional database reports.

While the method of the preferred embodiment of the present inventionutilizes a computer apparatus and computer programming code, formulas,and functions to compile, process, transmit, and report data andinformation, the method need not utilize a computer nor computerprogramming code, formulas, and functions. Instead, the method mayutilize any apparatus able to obtain, store, analyze, integrate,organize, and report at least one unit of information and/or data,whereby operational commands control the apparatus which utilizeselectric, magnetic, electromagnetic, chemical, and/or other suitableforms of energy to:

(a) acquire information and/or data from living entities and/or fromnonliving storage sources (e.g., databases);

(b) store the information and/or data in aggregate independent storageunits (e.g., database files) and/or individual independent storage units(e.g., record files);

(c) analyze and/or integrate the information and/or data from one or aplurality of sources and organize them into portable formations able tobe transmitted to different locations; and

(d) generate output reports.

Although the descriptions above contains many specificities, theseshould not be considered as limiting the scope of the invention but asmerely providing illustrations of some of the presently preferred andvarious alternative embodiments of the present invention. Accordingly,the present invention includes all modifications and/or variations ofthe embodiments described herein with the scope of the invention limitedonly by the claims which follow.

What is claimed is:
 1. An apparatus with a modular structure foracquiring, storing, analyzing, integrating, organizing, transmitting,and reporting information and/or data and for presenting the informationand/or data as digital signals, comprising:(a) an electronic executionmeans providing control over said apparatus via instructions from atleast one algorithm, stored in at least one file, comprised of at leastone of computer programming code, macros, functions, and formulas; (b) auser input means for entering commands providing further control oversaid apparatus, and for entering said digital signals and algorithmsinto said apparatus; (c) a memory means for maintaining said digitalsignals in electronic and/or magnetic form; (d) a data and informationcompilation means for acquiring and storing said digital signals; (e) astorage means for storing at least one of said digital signals andalgorithms; (f) at least one independent record file and/or at least oneinternal database file providing a means for storing and transmittingsaid information and/or data referring to a single entity or occurrence;(g) at least one processing file providing a means for processing saiddigital signals; (h) at least one portable report file providing a meansfor storing and transmitting said digital signals in report readyformat; (i) at least one report format file providing a means forstructuring report formats and retrieving information and/or data fromexternal sources; (j) a presentation means for providing an indicationof said operation of said apparatus and for displaying said reports; and(k) an output means for outputting said reports; whereby said modularstructure provides a substantially flexible and efficient means by whichto compile, process, transmit, and report data and information,including the ability to readily modify modules without disrupting thestructure or content of the other modules; the ability to compile amultitude of data efficiently and with minimal sparseness and overhead;the ability to enter a multitude of data types in a single field; theability to utilize independent record files with differing fields; theability to track data and information longitudinally; the ability tointegrate, analyze, and organize a multitude of data and informationfrom a multitude of sources utilizing a multitude of algorithms and amultitude of data, information, and computer function and formulapatterns; the ability to transmit raw and processed data and informationin a substantially compact and efficient form; and the ability togenerate, with substantial ease and flexibility, reports comprised of amultitude of formats and contents.
 2. The apparatus of claim 1 whereinsaid data and information compilation means may utilize branching logicto facilitate the acquisition of said digital signals.
 3. The apparatusof claim 1 wherein at least one data/information retrieval andprocessing file provides a means for retrieving and processing saiddigital signals from said independent record file and for storing theprocessed digital signals in at least one processed digital signal file.4. The apparatus of claim 1 wherein at least one internal database fileprovides a means for storing said digital signals in database tables andprocessing said digital signals in said in database tables viaconventional and/or multidimensional database methods, artificialintelligence methods, and statistical analyses.
 5. The internal databasefile of claim 4 wherein said internal database file may be comprised ofat least one of:(a) a table record, comprising a database record in adatabase table, which is comprised of at least one of said digitalsignal elements from said independent record file; (b) an extended tablerecord, comprising a database record in a database table, which iscomprised of at least one of said digital signal elements from saidindependent record file together with at least one digital signalelements from said processed digital signal file; and (c) an aggregatedigital signal unit which is comprised of said digital signal elementsaggregated via database calculations.
 6. The apparatus of claim 1wherein at least one digital signal integration file provides a meansfor integrating, into at least one unified pattern, at least two digitalsignal elements comprising at least one of:(a) said processed digitalsignal files; (b) said internal database files; (c) external databasefiles comprising at least one element of information and/or dataresiding as digital signals in other than said processed digital signalfiles and said internal database files; (d) reference information filescomprising at least one element of reference information in digitalsignal form that is related to at least one element of said digitalsignals in said processed digital signal files and/or said internaldatabase files; and (e) the digital signal output from database analysisprograms, which may be comprised of a program selected from the groupconsisting of online analytic processors with multidimensionaldatabases, artificial intelligence programs, and statistical analysisprograms.
 7. The apparatus of claim 1 further comprised of a backupsystem which is comprised of:(a) an electronic execution means forcontrolling the apparatus via instructions of at least one algorithm;(b) a user input means for entering commands providing control over saidapparatus and for entering information and/or data into the apparatus;(c) a memory means for maintaining said data and information inelectronic and/or magnetic form; (d) a presentation means for providingan indication of said operation of said apparatus and for displayingsaid reports; and (e) an output means for outputting said reports;wherein said backup system provides a redundancy system for controllingthe operation of the present apparatus and for storing, presenting, andoutputting said digital signals.
 8. The apparatus of claim 1 comprisedof a user interactive means which is further comprised of:(a) a userinput means; (b) a user display means; and (c) a user output means;wherein said user interactive means provides for remote accessing andutilization of said apparatus, and further wherein said user interactivemeans facilitates at least one of information and/or data entry,transmission and control over said apparatus, and further wherein outputdata may be obtained from said apparatus via said user output means, andfurther wherein said user interactive means may be interfaced with saidapparatus by means of at least one of a telecommunication means, a radiocommunication means, and a satellite communication means, and may beutilized in one of a local area network and a wide area network.
 9. Amethod utilizing modular processes for acquiring, storing, analyzing,integrating, organizing, transmitting, and reporting information and/ordata, and for presenting the information and/or data as digital signals,comprising the steps of utilizing at least one algorithm comprised of atleast one of computer programming code, macros, functions, and formulasfor:(a) obtaining preexisting information and/or data from externaldatabases; (b) obtaining new information and/or data utilizingelectronic and/or nonelectronic means; (c) storing said preexisting andnew information and/or data as digital signals in at least oneindependent record file and/or at least one internal database file; (d)processing said digital signals; (e) producing at least one portablereport file; and (f) generating at least one output report indicative ofsaid digital signals utilizing at least one report format file; wherebysaid modular process provides a substantially flexible and efficientmeans for compiling, processing, transmitting, and reporting data andinformation, including the ability to readily modified modules withoutdisrupting the structure or content of the other modules, the ability tocompile a multitude of data efficiently and with minimal sparseness andoverhead, the ability to enter a multitude of data types in a singlefield, the ability to utilize independent record files with differingfields, the ability to track data and information longitudinally, theability to integrate, analyze, and organize a multitude of data andinformation from a multitude of sources utilizing a multitude ofalgorithms and a multitude of data, information, and computer functionand formula patterns, the ability to transmit raw and processed data andinformation in a substantially compact and efficient form, and theability to generate, with substantial ease and flexibility, customizedreports comprised of a multitude of formats and contents.
 10. The methodof claim 9, wherein the process for storing said preexisting informationand/or data comprises converting said preexisting information and/ordata from an external database into digital signals which are stored inat least one of said independent record files; and further wherein theprocess for storing said new information and/or data may compriseconverting said new information and/or data from said internal databaseinto digital signals which are stored in at least one of saidindependent record files.
 11. The method of claim 9, wherein saidprocess for obtaining new information and/or data via electronic meansis comprised of the steps of utilizing:(a) at least one query item forobtaining information and/or data in digital signal form by presenting arequest for said information and/or data via an electronic presentationdevice; (b) a query item header associated with each query itemcomprised of the steps of utilizing(c) a query item identifier foridentifying said query item with a unique alphanumeric string; (d) atleast one query item format code, comprised of an alphanumeric string,for indicating the form in which the query item is presented; (e) atleast one response instruction code, comprised of an alphanumericstring, for indicating the type of response instruction associated withsaid query item; (f) at least one branching logic code, comprised of analphanumeric string, for indicating Boolean branching logic variablesused to navigate the order of presentation of said query items; (g) atleast one branching criterion, comprised of an alphanumeric string, foruse in conjunction with said branching logic code for defining branchinglogic conditions; and (h) at least one branch to location, comprised ofan alphanumeric string, for use in conjunction with said branching logiccode for defining the query item for presentation; (i) at least oneresponse instruction module comprised of at least one responseinstruction unit associated with each said query item comprised of thesteps of utilizing(j) at least one response instruction item forpresenting, via a digital signal presentation device, instructionsindicating the manner in which said query item is to be answered; (k) atleast one response-instruction header associated with each responseinstruction item comprised of the steps of utilizing(l) at least oneresponse instruction identifier, comprised of an alphanumeric string,for identifying said response instruction items; (m) at least oneresponse instruction format code, comprised of an alphanumeric string,for indicating the form in which the query item is presented; (n) atleast one input prompt code, comprised of an alphanumeric string, forindicating the format in which an input prompt is presented; and (o) atleast one response validation code, comprised of an alphanumeric string,for indicating acceptable types of responses; or (p) said query itemswith their associated response-items combined within them for presentingsaid query items without utilizing said response instruction identifierand response instruction format code; whereby substantial varieties andquantities of data and information can be acquired with substantialefficiency, and whereby substantial modifications can readily be made tothe types of data and information acquired and to the manner in whichsaid data and information are obtained.
 12. The method of claim 9,wherein said process for obtaining new information and/or data vianonelectronic means is comprised of utilizing nonelectronic query itemsand response instruction items to obtain information and/or data whichare converted to digital signals.
 13. The method of claim 9, whereinsaid process for storing said preexisting and new information and/ordata as digital signals in at least one independent record file can berepeated over time;whereby said digital signals in said independentrecord files provide an efficient and effective means to track data andinformation longitudinally and to analyze them to determine historicaltrends.
 14. The method of claim 9, wherein said process for processingsaid digital signals comprises the steps of:(a) retrieving at least oneelement of said digital signals from said independent record file; (b)performing at least one processing routine on said digital signalscomprising at least one of a mathematical and/or logical analysis,formatting, and organizing of said digital signals; and (c) storing saidprocessed digital signals in at least one processed digital signal file;whereby said digital signals are transmitted and processed.
 15. Themethod of claim 9, wherein a process for storing said digital signals inat least one internal database file comprises of the steps of storingsaid digital signals in:(a) a table record, comprising a database recordin a database table, which is comprised of at least one of said digitalsignal elements from said independent record file; (b) an extended tablerecord, comprising a database record in a database table, which iscomprised of at least one of said digital signal elements from saidindependent record file together with at least one digital signalelements from said processed digital signal file; whereby said digitalsignals are transmitted to and combined in database tables.
 16. Themethod of claim 15, wherein said process for storing said digitalsignals in at least one of said internal database files furthercomprises an aggregate data/information unit which is comprised of saiddigital signals aggregated via database calculations.
 17. The method ofclaim 9 wherein at least one digital signal integration file integrates,into at least one unified pattern, at least two digital signal elementscomprising at least one of:(a) said processed digital signal files; (b)said internal database files; (c) external database files comprising oneelement of information and/or data residing as digital signals in otherthan said processed digital signal files and said internal databasefiles; (d) reference information files comprising at least one elementof reference information in digital signal form that is related to atleast one element of said digital signals in said processed digitalsignal files and/or said internal database files; and (e) the digitalsignal output from database analysis programs, which may be comprised ofa program selected from the group consisting of online analyticprocessors with multidimensional databases, artificial intelligenceprograms, and statistical analysis programs; whereby said digitalsignals from a plurality of sources can be saved as patterns in a singlefile.
 18. The method of claim 9 wherein said process for producing atleast one of said portable report files is comprised of the steps ofprocessing at least one digital signal element of at least one of saiddigital signal integration files and/or said processed digital signalfiles to produce at least one of said portable report files; and furtherwherein said digital signals in said portable report file are organizedinto one or a plurality of digital signal patterns and stored in one ora plurality of said portable report files;whereby said digital signalpatterns provide a flexible and efficient means for storing andtransmitting digital signals used to generate a plurality of said outputreports.
 19. The method of claim 9 wherein the process for generatingsaid output reports utilizing at least one of said report format file iscomprised of the steps of:(a) obtaining at least one element of saiddigital signals selected from the group consisting of said portablereport files, said external database files, and said referenceinformation files utilizing algorithms comprising said report formatfile; (b) processing said digital signals utilizing formatting templatesfurther comprising said report format file; and (c) generating reportsby presenting at least a portion of said report format file templatesand the processed digital signals therein to a presentation device;whereby said report format file templates and said processed digitalsignals therein generate, with substantial ease, customized reportscomprised of a multitude of formats and contents; and further wherebysaid reports can be comprised of digital signals from a plurality ofsources; and further whereby said reports can present longitudinal aswell as single occurrence data and information.